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Optimal  Rate  of  Convergence  of 
Monotone  Empirical  Bayes  Tests  for  a  Normal  Mean 


Shanti  S.  Gupta  and  Jianjun  Li 
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Purdue  University  Purdue  University 

W.  Lafayette,  IN  47907  W.  Lafayette,  IN  47907 

Abstract:  This  paper  studies  monotone  empirical  Bayes  tests  for  a  normal  mean  under 
a  linear  loss.  The  optimal  rate  of  convergence  of  the  monotone  empirical  Bayes  tests  is 
obtained.  Applying  a  few  techniques  and  using  the  non-uniform  estimate  of  the  remainder 
in  the  central  limit  theorem,  we  are  able  to  construct  a  monotone  empirical  Bayes  test  and 
show  that  it  achieves  the  best  possible  rate  over  a  broad  class  of  prior  distributions,  while 
the  best  possible  rate  is  obtained  through  an  idea  of  Donoho  and  Liu  by  constructing  the 
“hardest  two-point  subproblem” .  This  answers  the  question  raised  recently  by  Karunamuni 
and  Liang.  The  result  indicates  that  n~^  may  not  be  an  attainable  lower  bound  for  the 
monotone  empirical  Bayes  tests  in  the  continuous  one-parameter  exponential  family.  A 
method  to  construct  the  monotone  empirical  Bayes  test  achieving  the  optimal  rate  is  also 
discussed  in  this  paper. 

AMS  1991  subject  classification:  Primary  62C12;  secondary  62F03,  62C20. 


Keywords  and  phrases:  Empirical  Bayes,  regret,  optimal  rate  of  convergence,  minimax. 


2 

1.  Introduction.  Let  X  denote  a  N{d,  1)  random  variable,  where  6  is  the  parameter, 
which  is  distributed  according  to  an  unknown  prior  distribution  G  on  (-oo,  oo).  We  consider 
the  problem  of  testing  the  hypotheses  Hq  :  6  <  0  versus  Hi  :  6  >  0.  The  loss  function 
is  /(^,  0)  =  max{^,0}  for  accepting  Hq  and  =  max{-0, 0}  for  accepting  Hi.  A 

test  <i(a:)  is  defined  to  be  a  measurable  mapping  from  (-oo,  oo)  into  [0, 1]  so  that  ^(a:)  = 
P{  accepting  i/ll  AT  =  a:},  i.e.,  5(a;)  is  the  probability  of  accepting  Hi  when  X  =  a:  is 
observed.  Let  R{G,  (5)  denote  the  Bayes  risk  of  a  test  5  when  G  is  a  prior  distribution.  Given 
that  £^[|6>|]  <  oo,  a  Bayes  test  Sc  is  found  as 

6c{x)  =  1  if  E[9\X  =  a;]  >  0,  and  Sg{x)  =  0  if  E[6\X  =  a:]  <  0. 

Because  E[9\X  =  a;]  involves  G,  the  above  solution  works  only  if  the  prior  G  is  known.  If  G  is 
unknown,  this  testing  problem  is  formed  as  a  compound  decision  problem  and  the  empirical 
Bayes  approach  is  used.  Let  Xi,X2,  •  •  •  ,X„  be  the  observations  from  n  independent  past 
experiences.  Based  on  X„  =  (Xi,  X2,  •  •  • ,  X^)  and  X,  an  empirical  Bayes  rule  <5„(X,  X^) 
can  be  constructed.  The  performance  of  is  measured  by  R{G,Sn)  -  /?(G,  5g),  where 
R{G,Sn)  =  E[R{G,5n\Xn)].  The  quantity  RiG,Sn)  -  R{G,5g)  is  referred  as  the  regret 
Bayes  risk  (or  regret)  in  the  literature. 

The  empirical  Bayes  approach  was  introduced  by  Robbins  (1956,  1964).  Since  then,  it 
has  been  widely  used  in  statistics.  For  its  applications  in  testing  problems,  much  research 
has  been  done.  For  example,  Johns  and  Van  Ryzin  (1972)  studied  the  empirical  Bayes 
tests  for  the  general  continuous  one-parameter  exponential  family.  Van  Houwelingen  (1976) 
constructed  the  monotone  empirical  Bayes  tests  for  the  same  family  and  showed  that  the  tests 
have  good  performance  for  large  samples  and  small  samples  as  well.  Stijnen  (1985)  studied 
the  asymptotic  behavior  of  both  the  monotone  empirical  Bayes  rules  and  non-monotone  rules. 
Karunamuni  and  Yang  (1995)  also  studied  monotone  rules  and  their  asymptotic  behavior. 
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For  the  problem  described  above,  Karunamuni  (1996)  “claimed”  that  he  obtained  the 
optimal  rate  of  convergence  of  monotone  empirical  Bayes  tests  (in  minimax  sense).  Later, 
Liang  (2000a)  and  Liang  (2000b)  obtained  a  faster  rate  than  Karunamuni’s  “optimal  rate” . 
So  an  interesting  question  arises:  what  is  the  optimal  rate  of  empirical  Bayes  tests  for  the 
normal  mean?  We  shall  answer  the  question  in  this  paper. 

After  introducing  some  preliminary  results  in  Section  2,  we  start  our  answer  with  consid¬ 
ering  monotone  empirical  Bayes  tests  for  a  single  prior  in  Section  3.  A  method  to  construct 
monotone  empirical  Bayes  tests  is  suggested.  A  typical  rule  is  constructed  from  this  method 
and  an  upper  bound  of  its  regret  is  obtained  using  the  non-uniform  estimate  of  the  reminder 
in  the  central  limit  theorem  (Theorem  3.1).  In  Section  4,  we  use  the  results  in  Section  3 
to  get  a  upper  bound  of  monotone  empirical  Bayes  tests  over  a  broad  class  of  prior  dis¬ 
tributions  (Theorem  4.1).  And  a  lower  bound  is  obtained  by  careful  construction  of  the 
“hardest  2-point  subproblem”  (Lemma  4.3  and  Theorem  4.2).  Then  we  find  the  optimal 
rate  of  monotone  empirical  Bayes  tests.  And  clearly,  all  the  empirical  tests  based  on  the 
method  in  Section  3  achieve  the  optimal  rate.  All  proofs  are  given  in  Section  5. 

2.  Preliminary.  To  ensure  that  the  Bayes  analysis  can  be  carried  out,  we  assume 
IJ,G  =  I  \9\dG{9)  <  oo.  Also,  assume  P{9  >  0)-P{9  <  0)  >  0  in  the  following.  1{P{9  >  0)  =  0 
or  P{9  <  0)  =  0,  it  is  known  which  action  one  should  take  regardless  of  the  value  of  x.  So 
both  these  cases  are  excluded  from  the  decision  problem. 

Denote  the  density  of  X  by  f{x\9)  =  c{9)  exp{9x)h{x),  where  c{9)  =  exp(-0^/2)/\/^ 
and  h{x)  =  exp{-x^/2).  Let  fcix)  =  /  f{x\9)dG{9)  be  the  marginal  density  of  X.  Denote 
(f>G{x)  =  E[9\X  =  x]  and  w{x)  =  -  J 9f{x\9)dG{9)  =  -fG{x)(f>G{x).  Since  ^g  <  oo,  fcix), 
(f>G{x)  and  w{x)  are  infinitely  differentiable. 

Noting  that  fG{x)  >  0  and  <t>G{x)  is  increasing,  the  Bayes  rule  stated  in  Section  1  can  be 


« 


represented  as 

/ 

1  if  (t>G{‘3^)  >  0  w{x)  <  0  x>  Cg, 

Sg(x)  =  {  (2-^) 

0  if  (I)g{^)  <  0  w{x)  >  0  X  <  Cg, 

where  cg  =  sup{a: :  w{x)  >  0}.  cg  is  called  the  critical  point  corresponding  to  G. 

study  of  (1985))  for  discussions 

Since  the  Bayes  rule  Sg  is  characterized  by  a  single  number  cg,  a  monotone  empirical 
Bayes  test  (MEBT)  can  be  constructed  through  estimating  cg  by  c„(Xi,  X2,  •  •  • ,  Xn),  say, 
and  defining 

(5„  =  1  if  X  >  Cn,  and  <5„  =  0  if  x  <  Cn-  (2-2) 

Note  that  R{G,S)  =  9dG{6)  +  fS(x)w(x)dx.  Then  the  regret  of  6^  is  expressed  as 

R(G,  Sn)  -  R{G,  6g)  =  E  f  w(x)dx.  (2.3) 

Jcn 

3.  A  class  of  MEBT’s.  Before  considering  the  optimal  rate  of  MEBT’s  over  a  class 
of  prior  distributions,  we  consider  MEBT’s  for  a  single  prior  in  this  section. 

Let  k{x)  be  a  kernel  function  of  form  k(x)  =  (27r)-^  /  exp(zte)A(<)<it,  where  \{t)  satisfies 
X{t)  =  1  in  a  neighborhood  of  the  origin.  This  type  of  kernels  could  be  found  in  Devroye 
and  Gyorfi  (1985).  Two  typical  examples  are 

k(^x)  =  (7rx)~^  sill X  or  k{x)  =  {A/t^x  ){[sin(x/2)]  —  [sin(x/4)]  }. 

See  Hall  and  Marron  (1988).  MEBT’s  can  be  constructed  based  on  these  kernels  and  the 
asymptotic  behaviour  for  the  MEBT’s  is  the  same.  For  simplicity,  we  use  k{x)  ==  (7ra;)“^  sin  x 
in  the  following.  For  this  k{x),  \{t)  =  /[|i|<i].  Let  u  =  Un  =  (lnn)-V2  (^i„  =  1  if  n  =  1). 

Denote 

W„(x)  =  n-*  -  l(Xj/u)k((Xi  -  !)/«)]}.  (3.1) 
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It  is  shown  later  that  Wn{x)  is  a  consistent  estimator  of  w{x). 

Liang  (2000a,  2000b)  have  constructed  empirical  Bayes  rules  based  on  (3.1)  by  mimicking 
the  Bayes  rule  (2.1).  The  approach  we  are  using  here  is  different  from  his. 

Let  ^  =  Cn  =  (Inlnn)^/^.  Observe  that  cq  =  i[w(x)>o]dx  —  ^  as  n  is  large.  Then  define 


—  j  ^lWn(x)>o]dx  — 


(3.2) 


and  propose  6nix)  as 


5n  =  I  if  X  >  Cn  and  =  0  if  X  <  Cn- 


(3.3) 


To  consider  the  convergence  rate  of  we  first  express  the  regret  of  through  Cn  —  cc- 
Throughout  this  section,  assume  that  E^OW  <  oo  and  P{9  >  0)  •  P{9  <  0)  >  0. 

Lemma  3.1.  — oo  <  cg  <  oo  and  —w'(cg)  =  /  9^f{cG\9)dG{9)  >  0. 


Lemma  3.2.  Fore  >  0,  let  A,  =  inf^g[c(,_«,CG+6][-w'(a;)]  andw,  =  sup^g[^^_,_cG+£]  k'(a;)|- 
Then  3  c©  >  0  such  that  for  e  <  ec,  >  A^^  >  0  and 

R{G,  Sn)  -  R{G,  5g)  <  l/2w,E[{Cn  -  Cg)"]  +  liGe-^E[{cn  -  Cg)%  (3.4) 


As  n  is  large,  cg  E  [-^,  and  c„  -  cg  =  -  /.!f  ^[u'„(x)<o]cfa^  +  74  dlWn(x)>o]dx.  To  study  the 
rate  of  c„  going  to  cg,  we  rewrite  Wn{x)  as  Wn{x)  =  n~^  Yfj=\  Vni^i^x),  where  F„(Xj,  x)  = 
[k'{{Xj  —  x)/u)/u^]  —  [{Xj/u)k{{Xj  —  x)/u)\.  Note  that  Vn{Xj,x)  are  i.i.d.  for  fixed  x  and 
n.  So  the  non-uniform  estimate  of  the  remainder  in  the  central  limit  theorem  can  be  used 
to  find  P{Wn{x)  >  0)  and  P{Wn{x)  <  0)  for  each  x  G  Combining  the  properties  of 

w{x)  on  [— tbe  following  result  is  derived  in  Subsection  5.3. 
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Theorem  3.1.  6n  has  a  rate  of  convergence  of  (lnn)^-®/n.  Moreover, 

lim  |n-'(lnn)'  ®[i?(6',<5„)  <  [ttx/S  f  9^f{cG\d)dG{9)]-\  (3.5) 

n-^oo  I  ^  J 

Remark  3.1.  Liang  (2000a)  studied  the  problem  under  a  critical  condition  that  cq  G 
He  constructed  an  empirical  Bayes  rule  5*  with  a  rate  (lnn)^-^/n.  Later  Liang 
(2000b)  constructed  another  rule  with  rate  (In  n  without  the  assumption  cq  €  [—A,  A\. 

Since  5^  requires  cq  G  [-A,  A]  and  A  must  be  given  in  the  construction  of  (J*  does  not 
achieve  the  best  possible  rate  as  5n  does  in  Theorem  4.1  (below).  To  illustrate  this,  let 

=  {Gi  :  PgXO  <  0)  •  PGi(^  >  0)  >  0,z  =  1,  •  •  •  ,m}  be  a  finite  set  of  prior  distributions. 
Then  Go  G  G  for  some  (unknown)  hq,  b  and  L  {G  is  defined  in  (4.1)  below).  From  Theorem 
4.1,  5n  has  the  rate  (Inn)^  Vn  over  Go  clearly  and  does  not  necessarily.  Even  through 
has  the  rate  (lnn)^  ®/n  for  a  single  prior  G,  5*  is  not  robust  and  the  assumption  cg  G  [-^1,  A] 
is  difficult  to  check  in  applications. 

Remark  3.2.  In  (3.2)  we  use  the  integration  of  /[iy„(a;)>o]-  This  technique  is  similar  to  an 
idea  used  by  Brown,  Cohen,  and  Strawderman  (1976),  Van  Houwelingen  (1976)  and  Stijnen 
(1985).  Another  technique  used  in  (3.2)  is  localization.  We  have  the  integration  only  from 
— ^  to  i  in  (3.2)  through  localization.  As  n  oo,  [— ^,  expands  to  the  whole  interval.  But 
it  is  a  compact  interval  for  each  n.  Instead  of  considering  Wn(x)  and  w{x)  for  rr  e  (-oo,  oo), 
we  consider  them  only  for  a:  G  [-^A]  and  therefore  many  crucial  properties  of  W„(a:)  and 
w{x)  can  be  obtained.  For  more  mathematical  details,  see  Lemma  5.1  and  the  proof  of 
Theorem  3.1  in  Subsection  5.3.  Statistically,  the  rationale  behind  (3.2)  is  that,  according  to 
the  monotonicity  of  ^g{^}>  would  like  to  accept  Hi  if  x  is  quite  large  and  accept  Ho  if 
X  is  qxiite  small.  Here  we  use  — f  and  f  as  cut-off  points  since  c^  G  [  ^]. 

Remark  3.3.  Theorem  3.1  gives  a  useful  formula  for  estimating  the  constant  in  the 


upper  bound.  For  example,  if  G  is  symmetric  with  support  [-1,1]  and  P{\6\  >  0.5)  >  0.5, 
then  {7^^/3/02/(cG|0)dG(0)}-l  <  6.2. 

4.  Optimal  Rate.  We  obtain  the  optimal  rate  over  a  broad  class  of  prior  distributions 
in  this  section.  Define, 

e  =  {G :  J.G  <  iMh  \cg\  <i,j  e‘‘f(cG\e)dG(e)  >  i}.  (4.1) 

where  ^0  >  0,  5  >  0  and  L  >  0  may  be  unknown.  We  assume  that  ^  is  a  broad  class  so  that 
G{e)  =  A^(^,  1)  e  Q.  Let  ^  9c{9)eyip{6x)dG{6).  Clearly,  -‘tp'{x)  >  0.  Actually, 

—‘tl}'{x)  has  a  (positive)  uniform  lower  bound  on  [—5, 6]  over  Q. 

Lemma  4.1.  For  some  ^>0  >  0,  infcgg infa;£[_6_i,i,+i] 

Following  the  proof  of  Theorem  3.1  and  applying  Lemma  4.1,  we  have  the  following 
theorem. 

Theorem  4.1.  For  some  I  >  0,  sup(5gg;[i?(G,  ^n)  —  ^  •  (lnn)^-^/n. 


Next  we  shall  find  a  lower  bound  of  MEBT’s  over  Q.  In  the  following,  let  h,  h,  •  •  •  denote 
positive  constants,  which  may  have  different  values  on  different  occasions. 

Let  C  be  the  set  of  estimators  c*  of  cq  and  V  be  the  set  of  empirical  Bayes  rules  of  type 
(2.2)  with  Cn  =  c*^e  C.  Let  C  =  {c;v(-6)A6  :  G  C}.  Fore*  G  C,  denote  Cn  =  c;v(-6)A5. 
Then  by  Taylor  expansion  and  Lemma  4.1 


[  w{x)dx  >  h{b)  f  'lp{x)dx  =  —l/2h{b)'lp'{Cn){Cn-CG)^>ll{Cn  —  CG)^,  (4.2) 

Jcl  J Cn 


Note  that  R{G,S*)  -  R{G,Sg)  —  E[fc-^  w{x)dx]  and  C  cC. 


inf  sup[i?(G,5;)  -  i?(G,(5G)]  >  k  inf  sup£;(c„  -  cg)^  >  h  inf  sup£^(c;;  -  cg)^  (4.3) 

<5nex>Ge£;  cr^eCceG  GeG 


Let  F  =  {fG{x)  :  G  e  G}  and  c/  be  the  critical  point  corresponding  to  /.  For  /i,  /2  G  F, 
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let  xHfuf2)  =  be  the  distance  of  /i  and  /a-  Then 

inf  sup  E{c*^  —  cg)^  >  h  sup{(c/j  —  c/j)^  ■  h)  ^  ^2/^)  V/i,  /a  G  ,  (4-4) 

Gee 

^4.4)  was  proved  in  Donoho  and  Liu  (1991)  and  others.  ^Ve  shall  find  a  lower  bound  of 
RHS  of  (4.4  )  through  a  careful  construction  of  “hardest  2-point  subproblem”  (Donoho  and 
Liu  (1991)),  i.e.,  we  need  to  construct  /i  and  /2  such  that  the  supermum  of  RHS  of  (4.4)  is 
obtained.  This  type  of  construction  is  often  used  to  find  a  lower  bound  for  various  problems; 
see  Fan  (1991,  1993)  for  example.  But  the  construction  for  this  empirical  Bayes  testing 
problem  appears  so  different:  we  cannot  find  /i  first  and  then  find  /2  in  the  x^-distance  ball 
around  /i.  Here  the  center  of  the  ball  is  moving  too.  Let  fi{x)  =  J  f{x\6)gi(6)d9,  where 

g^{0)  =  mic(^)[l  +  uei{e  >  0)]  and  92(0)  =  m2[9iie)  +  u^c{e)H {^d/u)] 

with  (i)  V  such  that  (ii)  satisfies  f  gi{9)de  =  1  for  i  =  1,  2,  (iii)  H(x)  = 

(27r)-^/A/f(t)exp(ite)df,  and  Anit)  =  exp{t^/{2u^))I[\t]<i]- 

Lemma  4.2.  As  n  is  large,  fi  G  iF,  x^ifii  f^)  ^  ^2/^,  and  (cf,^  —  c/2)  ^  Iz  '  (Inn)  /n. 

Based  on  (4.3),  (4.4)  and  Lemma  4.2,  the  next  theorem  follows  naturally. 

Theorem  4.2.  For  some  I  >  0,  infj.eusupG6£;[R(G,  ^^)  -  R(G,<5g)]  >  I '  (lnn)^  ®/n. 

Remark  4.1.  Theorem  4.2  tells  us  that  the  best  possible  rate  of  MEBT’s  is  (lnn)^-®/n. 
Based  on  Theorem  4.1  and  Theorem  4.2,  one  sees  that  the  optimal  rate  of  convergence  of 
MEBT’s  is  {\nny-^/n  and  achieves  this  optimal  rate. 

Remark  4.2.  For  a  long  time,  it  was  thought  that  is  a  lower  bound  of  empirical 
Bayes  rule  for  the  continuous  exponential  family  (including  the  normal  distribution);  see 
Singh  (1979)  for  his  conjecture  about  the  estimation  problem.  Surprisingly,  we  obtain  that 
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the  best  possible  rate  for  the  normal  distribution  is  (lnn)^-^/n.  So,  even  through  is  a 
lower  bound  for  general  continuous  exponential  family  (see  Gupta  and  Li  (2000) ),  we  believe 
that  is  not  obtainable. 

5.  Proofs. 

5.1.  Proof  of  Lemma  3.1.  Note  that  P{9  >  6^)  >  0  for  some  9^  >  0.  And  also 

9c{9)  exp{9x  -  9^x)dG{9)  +  9^  c{9)  exp{9x  -  9^x)dG{9) 

G\^  _  exp(^3;  -  9^x)dG{9)  +  c{9)  exp(0a;  —  9^x)dG{9) 

Then  lima;_4oo  <?!>G(a;)  >  9^  >  0.  Therefore  cq  <  oo.  Similarly  cc  >  -oo.  It  is  clear  that 

-w'ica)  =  f9^f{cG\9)dG{9)  <  oo.  This  completes  the  proof  of  Lemma  3.1. 

5.2.  Proof  of  Lemma  3.2.  Since  w'{x)  is  continuous,  >  0  for  some  cg-  As  e  <  ec, 

fCG  f<^G 

R{G,Sn)-  R{G,6g)  <  E[I[\c„-CG\>e]  w{x)dx]  +  E[I[^Cn-CG\<e]  w{x)dx] 

JCn  Cn 

<  HG^-^EiCn  -  CgY  +  ll2w,E{Cn  -  Cg? . 

where  w{x)dx  <  ^\w{x)\dx  <  hg  and  by  Taylor  expansion 

^[|cn-co|<€]  f  w(x)da:  =  -1/2  X  w'{Cn){Cn  -  CG)^/[|c„-CG|<d  ^  1/2u>£(c„  -  Cg)^- 
Jcn 

5.3.  Proof  of  Theorem  3.1.  We  prove  Theorem  3.1  in  two  steps. 

Step  1:  We  present  two  lemmas.  Their  proofs  are  in  Subsection  5.7  and  5.8. 

Denote  Wn{x)  =  E[Vn{Xj,x)],  Zjn  =  Vn{Xj,x)  -  Wnix),  al  =  E[Zj.^]  and  7n  =  E[\Zjnf]. 
Let  p  =  l/ylTTV^,  dn  -  l/vW^  and  =  1  -  {pit)~^pgu^^^- 
Lemma  5.1.  The  following  statements  hold  {as  n  >  5). 

(i)  For  e  >  0,  3  Mf  >  0  such  that  |u;(rc)|  >  Mi{lnn)~^  for  x  G  [— ^,^]\[cg  —  3-  e]. 

(ii)  For  X  G  (-00,00),  lwn(a:)  -  w{x)\  <  tt'Vg  •  ■uexp(-l/(2M^))  =  din- 

(iii)  Forx  G  <Xn  <  d2nU~^^^,  d2n  =  (37r)“^/^  + 
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(iv)  For  X  e  7  —  1  +  2/^g- 

Lemma  5.2.  If  a:  e  (-^,^)  and  u;(a;)  >  pdn, 

P{Wnix)  <  0)  <  ^{-V^qnw{x)/d2n)  +  Aj / {qlu^n^iwix)]^} .  (5.1) 

If  a:  e  (-^,0  and  w{x)  <  -pdn, 

P{Wn{x)  >  0)  <  [1  -  ^{-VmPqnw{x)/d2n)]  +  Aj / {qlu^n‘^\w{x)\^} .  (5.2) 

where  A  is  some  constant  and  $(•)  is  the  c.d.f.  of  A^(0, 1). 

Step  2:  We  present  the  main  proof.  Since  (3.4)  holds  for  any  small  e  and  A^  -w'{cc) 
as  e  0,  we  only  need  to  show  that 

li^{(nn^)£'[(c„  —  Cg)^]}  <  2/(7r\/3[ti^'(cGr)]^),  ^lii^{(n«^)£^[(Cn  —  Cg)  ]}  =  0-  (5-3) 

Let  /  =  d^\Y^(^x)<o]dx  and  II  —  j^o  ^Wn{x)>o]dx.  Then  Cn  —  Cg  —  ~~I  +  II-  For  e  <  cgj  lat 

-qi  =  Co  —  €•  As  n  is  large,  pi  >  — Then  P  <  2^Ii  +  2/|  +  2/3,  where 

h  =  j  I[Wn(.x)<o]dx^  ^2  =  I[w{x)<pd„]dx,  h  =  I[Wn{x)<o,w{x)>pdn]dx. 

For  X  e  w{x)  >  Me(lnn)-^  >  from  Lemma  5.1.  Then  by  Lemma  5.2 

^E[h]  <  e  P{Wn{x)  <  0)dx  <  Zi4>(-n^/^)  +  =  o{n-^).  (5.4) 

For  X  e  [vi,cgI  -w'{x)  >  A,  (>  A,^  >  0).  Thus  by  letting  y  =  w(x)/(pd„), 

/*^G  ^00 

I2  <  A~^  /  I[w(x)<pdn'jl-1^'(^)}^^  ^  pdnAl^  I[y<i]dy  =  pdnAl  .  (5.5) 

Jrji  "'0 

By  Holder  inequality  and  Lemma  5.2, 

E[ll]  <  [  r  w-Hx)I^^^x)>pdn]dx]  •  [  r°  P{Wn{x)  <  0)w^ix)li^^x)>pdn]dx]  (5.6) 

Jrii  drji 

POO 

<  [{2A,)-'^p-^d-^]  ■  [A;^dt^q-\nu^)-^  /  ^{-y)y^dy  +  A'yeq-^-^n-^] 

From  (5.4)-(5.6), 

lim  {{nu^)E[P]}  =  lim  lim  {{nu^)E[P]}  <  l/(7r\/3[w'(cG)]^). 

n-xx)*-^  e-¥0n-yoo'-' 
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Similarly,  \imn^oo{{nu^)E[n^]}  <  l/(7r\/3[w'(cG)]^).  Then  the  first  part  of  (5.3)  is  proved. 
The  second  can  be  proved  similarly.  The  details  are  omitted. 


5.4.  Proof  of  Lemma  4.1.  Note  that  cq  €  [—b,b]  and 

L<  I  e^c{e)  exi>{9cG)dG{0)  <  j  6'^c{6)  exp(6|^|)dG(^)  <1-  /A)dG{d). 

Then  we  can  find  ^oi  >  0>  ^02  >  0  sind  eg  >  0  such  that  P{9q\  <  |^|  <  ^02)  ^  ^9  for  all  G  E  Q. 
Therefore  for  x  E  [—b  —  1,6+1], 

l-ip'ix)]  =  J  9^c{9)  exp{9x)dG{6)  >  J  9^c{9)  exp{-\9\{b  +  l))I[eQ^<\g\<0oi]dG(9)  >  0. 

5.5.  Proof  of  Theorem  4.1.  Based  on  the  proof  of  Theorem  3.1,  in  order  to  prove 
Theorem  4.1,  it  is  sufficient  to  show  that  there  is  0  <  eo  <  1  such  that  as  ^  >  6  +  1 


(a) 

(&) 

(c) 


inf  inf  |u;(a:)|  >  fi/ Inn; 

G£G  a;6[— ^,cg— co]u[cg'+€o,^] 

inf  inf  [— >  I2  (>  0); 

G€exe[cG-eo.CG+«o] 

sup  sup  [—to' (a;)]  <  I3  (<  00). 

GqQ  x6[cg— cojCg+^o] 


Recall  ^{x)  =  -  J  9ci9)  exp{9x)dG{9).  Then  \^'{x)\  <  f  9^c{9)  exp{{b  +  l)\9\)dG{9)  for 
a:  E  [-6-  1,6+  1].  Note  that  exp((6  +  1)|0|)  is  bounded.  Therefore 


sup  sup  |'0'(a;)|  <  Z4.  (5.7) 

Gec?xe[-b-i,b+i] 

Let  eo  =  [l/2^ofi(^>  +  l)/((^  +  1)^4)]  A  (1/2),  where  ipo  is  defined  in  Lemma  4.1.  It  is  easy  to 
check  that  (a),  (b)  and  (c)  hold  for  this  cq.  The  details  are  omitted,  theorem. 


5.6.  Proof  of  Lemma  4.3.  We  prove  it  in  three  steps. 

Step  1:  To  prove  /j  E  J"  as  n  is  large.  Clearly  gi{9)  >  0  and  mi  1.  Simple  algebra 
computations  show  that  M"|i7(\/26/n)|  <  2iyitand  \  J  c{9)H{-\/29/u)d9\  <  u.  Then^2(^)  >  0 
as  n  is  large  and  (1  -ms)^  =  0(n2"+^).  Let  Wi{x)  =  -  J  9f{x\9)gi{9)d9  for  t  =  1  and  2.  One 
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can  see  that  wi{-u/Z)  >  0  and  Wi{-u)  <  0  as  n  is  large.  Therefore  -u  <  Cf,  <  -m/3  aad 
eg  for  large  n.  Similarly,  g2  G  Q-  Therefore  fi{x)  G 

Step  2:  To  prove  x"(/i,  /a)  <  h/n.  Note  that  fi{x)  >  rm  f  c{e)f{x\9)d9  >  h  exp(-a;V4) 
and 

[/2(^)  -  <  2(1  -  J  f(x\9)c{9)H{V29/u)d9f. 

Then 

X^(/i.  /a)  <  j [ /  exp(-(^  -  x/2f)H{V29/u)d9fdx. 

It  turns  out  that  xHfi,  /a)  =  gjnce  using  Parseval  identity 

/|/exp(-(0-  x/2f)H{y/29/u)d9fdx  <  h  f  [f  exp{-{v  -  yf/2)H{'n/u)dr]fdy 

=  hu  j  IXniy  /'u'^)dt 

<  2I4U. 

Step  3:  To  prove  (c/,  -  cj^  >  h{\nny/n.  Note  that  m(a;)l  is  bounded  for  all 
X  e  [—b,b]  and  all  n.  Then  [ry2(c/i)]^  =  [^2(^/2)  — 'f^a(c/i)]^  ^  ^1(^/2  —  c/j)^  and  (c/j  —  c/J  > 
h[Mch)?-  Let  xo  =  c/,/x/2.  Then  -u/^/2  <  xq  <  -u/{^^/2).  Using  integration  by  parts, 

ha(c/J|  =  hu'’ex^{-xl/2)-\  j  yexY>{-{y-Xofl2)H{r]/u)dy\ 

>  j expi-iy  -  xo)^/2)H'{r]/u)dr}\ 

-ku'^lxo  J  e.xp{-{r}  -  Xof /2)H{r]/u)dr]\ 

>  hvy~^  f  tsin{t/6)dt  —  . 

Jo 

Then  {cf^  -  c/,)^  >  =  hilnny/n. 

5.7.  Proof  of  Lemma  5.1.  Forrr  G  >  (Inn)-Und  |M;(a;)|  >  (lnn)-^|^(x)l. 

Since  ^{x)  is  decreasing  and  tpicc)  =  0,  then  (i)  holds  with  M,  =  [\^{cg  -  e)|  A  1i/;(cg  +  e)  |]. 
(ii)-(iv)  are  simple  algebra  calculations.  The  details  are  omitted. 
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5.8.  Proof  of  Lemma  5.2.  if  w{x)  >  pdn, 

^  w{x^  pdn  ~l~  pdji  din  ^  pdn  ^In  _ 

W{x)  ~  w{x)-pdn+pdn  ~  pdn 

Then 


/^/n^  0/1  ^  -V^Wnix)^  ^  1  ^-^/EqnW{x) 

P{Wn{x)  <  0)  =  P{-^  2^  Zjn  <  - - - )  <  P{-r=^  2_.  Zjn  <  - 1 - )• 


i=l 


ncrl  i=i 


Applying  Theorem  5.16  on  page  168  in  Petrov  (1995)  to  the  LHS  of  the  above  inequality, 


P{Wn{x)  <  0)  <  ^{-y^qnw{x)/an)  +  A7„/{Vn[a„  +  ^/nqnw{x)f}. 


Then  (5.1)  follows  Lemma  5.1.  (5.2)  can  be  proved  similarly.  The  details  are  omitted. 
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